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ROBOT FOR USE WITH ORTHOPAEDIC INSERTS 

FIELD OF THE INVENTION 

p«sen, invention relates to the field of the robotic guidance of 
ord^opaedic surreal procedures performed on P-P— ?^ 
espeluy for use in «.e orthopaedic reduction of bone ftactures usu^ 
intramedullary locking procedures. 

BACKGROUND OF THE INVENTION 

The need for precise. minimaHy invasive, surgical interventions has 
. rutted in the creation of methods of using computers in corunnCion 
advano«l assistance devices to improve surgical planning and execution, over 

past decade, a variety of such Computer Integrated Surgery (CIS) syste^^v 
been developed, with resulting clinical benefits, largely for nse m the fiel^f 

neurosurgery, laparoscopy. maxiUofeoial surgery and "^-P^-^-' ^ 

described in^earticlebyL.Iosko^ezetal..enti.led"Computersmunagmga^^ 

guided surgery", published in Computers in Science and Engineermg. Vol. 3(5). 

^ '"cis "^Lns can potentially benefit many orthopaedic surgical procedures, 
« total hip and total Vmee r^lacement. pedicle screw ~ 
action, and ACL (Anterior Cruciate Ligament) Ugament reconsmxctton. "n^ese 
procedures are ubiquitons and are performed to high vohmre in operatmg rooms 
worldwide. TI.ey generally involve rigid bone structures that image we«e 
p^perative planning, and employ instruments and tools. - -P^-"' 
Lws, drills, and saws that re,uirepreciseposifionh.g.Anumberof CIS sy^ 

fo, such procedures are currently in use. such as those descnbed n> the book 
"Computer Assisted Orthopaedic Surgery (CAOS)». edited by L.P. Nolte. and R- 
Ganz, published by Hogrefe and Huber (1999). 
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One tecnniq „™n,badc "Regular and Special Features - 

and, according to the aiticle by R-J. Brumbadc Kegm , „^_3„ 

Rationales of Interlocldng Nailing of .he Fen.ur. 
^rL in Clinical Orthopaedics and Related Research. Vol. 324. pp.586^51, 

to determine Ihe position of the holes to 

c renuired for this procedure, since the nan oncu 

V rav fluoroscopic views, such that me arm 

^L! ! th corresponding nail hole axis. Drilling P-eds .cre.^^^ 
^ Ich advance verified wid. a new pair of X-ray fluoroscopy Onc^ 
lepUothole passing through the distal locHng nail hole has heendnUed. the 

bone,thelockingsctewscanbeinsertedand6stened. 

Because of the nature of the procedure, depending very largely onto sWl 
of the ^ a -her of con«.Ucations c=. =«ise, including inadequate 
CnX«o. Wcrac^. cortical waUpenetration.dbo.— 

1 to multiple or enlarged pilot holes. Furthermore, it ^J^^^''; 

Lie -interlock — nails - taxation doses . ^^ ^l 
Sk^dalandS.Backe.publishedinArchivesofOrthopaed.cTraumaSurgery.V 
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106 pp 179-181, 1987. that the surgeon's direct e;<pos«re to radiation per 
pro:edure.usingthesepriorartme.hods, is 3-30 nnnu.es, depending on«^^ 

anatomy and the surgeon's skill. In general, somettring between about 30 and 50/. 
of this time is spent on the distal locking process. 

Many non-CIS devices have been developed for distal locking, even 
recently, such as that described by C. Kre«ek. et al. in Ihe article "A mech^ca 
distal Ling device for distal locking in femora, naib". published m Chntca^ 
orthopaedics. Vol. 384, pp. 267-275. 1999. Examples of such devices and 
procedures include proximaUy mounted targeting devices, stereo fluoroscopy, 
mechanical guides, and optical and electro-magnetic navigation systems that help 
locate the center of the distal locking nail holes. However, the» devtces and 
technKpes generally have some disadvantages, for instance that they are only 
selectively appUcable, may be cumbersome and difficult to -Y"! 
sufficiently accurate, and they thus 6il to significanfly reduce the hkehhood of 

patient complications. j u t 

Fluoroscopy-based CIS navigation systems, such as those described by L. 
Joskowicz, et al.-, in the article '"FRACAS: A system for computer-aided hnage- 
guided long bone fracture surgery", published in '•Journal of Computer-^ded 
surgery". Vol. 3(6). pp. 271-288, 1999, take the guesswork out of targeting. Such 
systems enhance, reduce, or altogether eliminate X-ray fluoroscopic images by 
replacing them wifl^avirtualreaUty view in which the positions of the bone and 

fl.e surgeon's instruments are continuously updated and viewed on-screen as^ey 
move, using tracking devices and three dimensional registration procedures They 
can assist the surgeon in aligning the driU axis with the distal locking narl hole 
axis to an accuracy of about 1mm and 1=. However, they do not pro^ie any 
mechanical guidance for flte hand-held drill, which can sUp or deviate from i^ 
planned trajectory as the drilling proceeds. Tt^, even using such prror art CIS 
navigation systems, the surgical outcome of fl>e procedure is still dependent to an 
extent on the skiU of the surgeon. 

Robot-based CIS systems have been developed to assist the surgeon m 
implementing the preoperative plan by mechanically positionmg and sometimes 
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executoga^e surgical action itself, one such sys«=m is described by K-Cleary^ 
-icle "State of tbe ^ in sursioal robotics: c-i--PP~ - 
l^ology cbaUenges". pubUsbed in Journal of C<»^--^''^^^^t 
«6) pp. 312-328. 2001. H^e robots are either floor-standrng mdustr«l robo^. 
^IZ for use in «.e desired surgical appUcation. or table-counted c^ton. 
X serial robots. Sucb robots are generally volun^ous and be». d^^ 
L that in such surgical appUcations. they need to operate ^ ^^l 
1,11 worHo^ and woric volumes. In such systen., bone unmob— or 
rrtilZ^ctracl^g.ein.por.ant issues, sincetherelativeconfigu^hon^ 
:l"vI.hrespectto«.erobotmustbe,a.ownp«ciselyataUtin>es.msmay 
rZtethere;strationprocedureandn.yadversely^.beoveraUsys.e. 

"ere therefore exists a need in the field of orthopaedic s^gery for a 
system Which overcomes the disadvantages of prior art systems, ^d enab es^e 
ItTcaligmnent of tools re^ed for the proced„re.^the bones or 
~dh.thZcedure.suchthattheproced„rebecomeslessdependent^^^ 

Tm of the sJgeon. ^ a concomitant h.crease in the success rate of the 
'"°^::edisclosuresofeachofthepubUcationsmentionedinthissectiona^i^ 
other sections of the specification, are hereby h^corporated by reference, each m 
its entirety. 

SUMMARY OF THE IKVENTION 

.represent invenUonseelcstoprovideanewrobotic guidance syste^^^ 
therobotmLted directly onthebone on Which the operationisbemgperfonned. 

::rconfigura«onw..cns^;— ^ 

irr^ri;;!::-:--^--— 

feaLes of internally located imph^ ^ ^ ^"Z^ll^y 
o*opaedicprooed„re.Iherobot itself is small, and is thus unobtrusrve and easUy 
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signifioantty reduces the likelihood of compUcations ansmg m m P 
:r.he Igica. too, in u.e . aHgned auto.« with '-J^^'^ 
,^,andan^«.y..— .theneedfor — ^.^^^^^ 

fluoroscopic i-nases is reduced. «.us ''-^^^XlZulZ^^'^ 
The system is particularly suitable for the automaho ahgnment of a booe arm 

rotates, the robot moves wifli it. thus preservmg 

position of the guide drill with the distal holes m the ^.^^e ro 

lternativelymo™^direcayonthenail..hisadvantagea^^^^^ 

Tl.e systempreferably comprises a miniatee robot holdmg at^g^ 
^ae.XherLbecauseofitssm.si.andweigl.jr.em— 
Z bone on which the desired procedure is being performed. In the case ot th 
:::rhrLeduU.aistalloc.h.procedur.the^^^^^^^ 

..erred embodiment attached to ^ . 
preferably.it is directly mounted lateraUy on the pattentsbon gm 

^ line and .oximal to ^^^^ ^^^t '^^^ 1 
Piiide oreferably has one or more guide holes for the drill, in 

fluoroscopic image distortion correction and 

^sults using these X-ray fluoro^pro mtages, ~ 
calibration ^ performed, prefen*ly using an mrage cahbratron 

fluoroscopic X-ray C-aim unit. the axis or 

Using only asmaUnumber of lateralX-ray fluoroscop.c mxag^*e a»s » 
using umjf alienment with the axis or 

axes of thetargeting drill guide holes are brought mto ahgmn 



PCT/IL03/00515 

WO 03/105659 6 

aligned essentially colinearly witti the aas ot m 

definedby the insert »is of the at least one hole defined by 

In the above described system, the axis 01 m axis of 

the driU guiding plate is prefeably aUgned essentiaUy cohnearly with «.e of 
Z TZ one pLriUed hole both « in angular onentatio. V. dnU 
the at leasx one p i„«,U+v of fiducial markers disposed in a 

guiding plate preferably comprises a plurality of tiduc 

. . This DluraUty of fiducial markers is preferably used to 

predetenmned pattern. Tb. p« ,^ ^ 

align the drill guiding plate by means of the roDox 
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images Ihe at least one p«dnUed hole m a ft P ^ 

fee computatioiial system may ahga flie robot oy 

image ofthe imaging system. 

There is tother provided m accordance w.th ^ ^ 

e^hc^ent o.the invention -"^^Xris 

------r'nr;" I" tlU system, the ro.ot 

..entio. . these surgical systems, .e ^^--^J^^^jtZ 

the intrameduUary naU. externally 
Alternatively and preferably, the orthopaedic insert may be 

.^:iecJpla...d.e..t.^^^^^ 

.ch c^. *e hone ^^Z^lll!^.... ^ 

percutaneous compression plate, and the or 

as to accommodate a screw for com.ectmg the plate to 

.eh.tocom.ecta.acturedheador.efem™.^^^^ 

^ any of ,.e above assembly, 

-TrrronT^rio^on eo^^n and c.era 

caUbration. ^ another preferred 

There is ftother provided m accordance wim s 

There is luim v described above, and 

embodiment of the present mvent.on. a --^ ^ 
..ereh. «.e robot comprises a mimatnrep^^^^^^^^^^^ 
comprisesatleastthreeactuatorsmountedonabasemem 
I^guredforatleastoneoftranslationalandrotationalmovement. 
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^acco.<^cewi«.&rme.p«fe.ede.boai»ents of U.e present U^veati^ 
thereis also provided animagmgsystemoompnsm^ 

(a) a radiation source for illuminatmg a target to be nnage 
having at least one predefined hole. .^g.^ tole, whose axis is to 

(d) an image mtensifier generatmg unages of the target 
guide, and 

^ , . 1 o+ taraet holc &om an image tiiereof, and 

^"""""iteltr^ - ada^ — ^ 
h^eentheatleastonet^get^ideholeand^e^.-^^^ 

^ the above described ^-^^ ^^^^^^.^^ ,.^.>ing the 
aliped in a ftonto-paraUel setup, such tot the re^ 
spatialrelationsMp between the at least one targe^g^ae^l-^^^ 
^.hole. utilizes a two-dimensional '"^ ^^ -J^ ^^^^ ^ 

by determining when an nnage ^ ^ 1 - - J^^^^ ^^^^^^ 
elliptic shape. The — /^^^^^ J, the 

«^.tion and camera calibration tochons. or "^^"^''^^ 
system also comprises a separate calibration rmg assembly for 

• a nredetetmined pattern of fiducial markers, the 
. ^^P-^^^^-'"''"^^jf^;3itionlocalizirig module in the 
hnages of whidi are utihzed by the nrsi p 
oomputtagtheposifionofthe at least one target gmde hole. 
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+v,» at least one image of me targci gui« 

— — " rr:::,'::^::!^ « • «*- 

negative values, determanmg the centers of ffi 

.„ss conelato. and (v) a position '^^^^^^f ^^"^^j;,, fiducial 
fton^lhelocationsofthcfiducialsfoundbythefi*. .M^^c^^^^^ ^ 

.„.e. position locator .d -^^^ ^^^'^^J^'^'^ . 
Hough transform method, and the positron locator preferably 
.o„ponentana..sisp,.c^ur. 

an edge detection routme. for detenmnmg the ' ^ 
(i, . .ole searcher. detem>ining the positron -^o' ^ » ^ ^ 

+v»f» tareet. usmg a detector lor 
.ng^^dinal contort .n^ -^^ *^^ 

aiemaximalnumberofedgeelementsmvrai j^e edge elements in 

^.eholemovedoverthe contour, and (iii) an eUtpse fitter forth^^^ 

each of the regions detected. Ihe edge detection routme . preferably 
.g^^tion unU adapted to determine a sp.a. 

one t^get guide hole and the at least one target ^ 

--°--^r:et:rh:"rCa^s.s.ae 

. r::Zi:r-leastone^eof.e^...-olehasa 



PCT/IL03/00515 

WO 03/105659 

^al eUiptic Shape, andatarget guide late^l—r so ll^t the positions of 

theaxesometargetguideholeanddetargetholeooincide. 

Using the imaging system in the above^escribed vanous ptef^red 
embodiments, there is tatherprovidedamethod of bringing the posiUonsome 

,.es of a hole defined by a target guide and a hole defined by the target m^ 
coincidence, comprising the steps of iooaii^g the position of the ^^de 
hoie^m at least one image .her.f.«t^e axis of the target h^eft^^^^ 

least one image thereofi and registering the localized target gu:de ho^ wtth ,he 
axis of the target hole. An initial step may preferably be performed of m«ge 
distortion correcfion and cahbrationofthe imaging system to ohtaintheimag^^^ 
the target guidehole^d the targethole. The htdividualcomputmg modules ofthe 

L^, Tstem embodiments described above operate accor^g to m^ 
^Zi methods of ^ present h^vention. as described in relation ,0 each 
functional module, and its parts. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The pr^ent invention wiU be understood and appreciated more fidly fi:om 
Ihe fonowmg detailed description, taken m conjunction vdlh the drawmgs m 

'*'*Figs lA^dlBareschematicrepresentationsoflateralandftontalviews 
respectively.such as wonldbeobtamedby X-ray fluoroscopic imaging illustratmg 
fl,e distal locking stage ofte intramedullary nailing procedure; 

Fig 2 is a schematic isometric illustradon of a robot-based system, 
constructed and operative according to a preferred embodiment of the present 
h,vention.for.heprecisedrillingofthepUotholesfor.ockingsc»wmserUon; 

Fig 3 is a cross-sectional view of the preferred embodmient of Fig. 2, 
showing some features which are not visible in the isometric view of Fig^ 2; 

Jg 4 is a ferther cross-sectional view of the robot of Fig. 2, showmg an 
alternative and prefenedmethodofmountingtherobottothepatienfs bone; 
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incorporated, according to a former P 

indention, tato the co^putingsystcmshow^fj. ^ 

showing the targeting dnU guide and the 

the two distal locldng holes; fluoroscopic image 

7 is a schematic representation of ^ J 

is detennined; another X-ray fluoroscopic image, 

Hg. S is a schematic ""^^ """"^""i.^^ co^^ 

determined; and robot-based system, similar 

Fig. 9 is a schematic cross sectional view 

plate. 

. ,„ Kus lA and IB, which are schematic 
Reference is first made s- ^ fluoroscopic una^ng, 
^..ons Of Views that -o-^^^;::^^^ procedure. Rg. 
iUustrating the distal locldng stage -^^^^^^ ^ of the distal 
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axid drives in the nail 14. The suigeon and inserts 

,„les in the bone, opposite the pre-prepa«d ^'^'''^l^ foment rotation 

-"-^—f^'^.tllylansofascrewariv^^ 
seconaone22..ssho.nhe.^^^ed'^ ^^^^^^^^^^^ 

Reference is now made to Fig. 2, preferred 
, . rohotW system, constructed .d -^^^T Xpi for 
e.hodin.e.itofthepresciitinven.on.fortheprec.se«oft^^^ 

locldng screw insertion. In the prefisrted embodime • 

through 

nail. It is to be understood to those skiUe 

modifications, ifat an neccssary.the system can a^op^f^^^^^^ ^^^ 
^eother.ongbones.thetibia.theh„tHe,i^^-i.-- 

for accurately drilling into P*^^ /'^'^^ J, ,«.ebo„e. 
..amed»naryn^.s„ohascomiect.pl.^d^^^^^ 

to Fig. 2, the patient's femur 10 is * , base 

.e-msertea. The robot 30 is pref^lv a — J^^^::^ ..d 
plate 34 for mountingpurposes.andatop plate ^-^c^^^^^^ 

.attached. Tlierobotshowninthcpreferr^emb^^-^^^^^^ 
&eorderof70mmandaweightofabout200grams. 

the desired 

ofitstopplate32canbeadjusted.dloc.^by^e»^^^^^^^^ 
configuration with high accuracy and ngi^ty. -r ^ 
^cient for the tas. at hand, which involves — ^^nTlng through 
pre-estimated approximate position into the correct position 
aedistalloddngholesinanintrameduUaryjiad. ^ 

robot carries a guiding assembly, -^-^^P-^^ J^^^ 
components, an adjusuible sUde head 33. a connectmg block 3 



PCT/IL03/00515 

WO 03/105659 13 

J; ;r:t of ..c suae, .^n^ on 

appUcadon envisaged. The use pr 

— t°™rr;;n::r-p--«.se.ec..^^ 

andftepos^onof the dnUmg ^ ^^^^ used in the 

input to the eon«,l system so that the drill 
.«nt position calculations. The connechng bl^^38^ 

„coptcnnagestoh^«.om^^^^^^^^^ 
preferably in the form of a 40 x 55 x 

Shown, has two drill guide holes '"^^ ^ of the 

^ch axe predetermined to correspond to fl>e spacmg 

----rrorr^g^rpi: - « .lae has 

34, and close to the stan of the leg ol m p spatial 
p^erminedpattemsoffiducialmarkersthatareused^d— 

i« the X-rav fluoroscopic images, in mc p 
-gul. ;f stainless steel spheres 

e^todiment shown m Ftg. 2^ ^ 
arranged in predetermmed patterns resemblmg 

lower surfeces. a, rnhot on the bone. In the 

diameter by SOmm leng*. self-tapping screws, mounted 25mm apart. 
Mvenintothedistalboneco^. ,^,Ms a cross-sectional view of the 

preferred embodm-^t m,^.^^ ^^^^^ 

the isometnc view of Fig- ^. me sc i- number 
...,opplateoftherobot32.dthesUdeheadS3^^™.jJ 

and positions in Hg. 3 are meant to be purely — ^^'^ ^„ 
ho J 16. 18. in tt.e intramedullary naU 14 are vrsrble. as are the tw 
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shown^«.toguidedriUbit72acc»ratelypo.Uonedby11>erobo 

Reference is now made to Fig. % wni „,eferred meHiod of 

^&ancxt«idedbase39,v*i embodiment, there is no need 

«, fl,e intrameduUary proxmal nad head 15. 1» 

i< r.f the embodiment or tig. J- 
for the mounting pms 35 of the emooonu v,n^:„ent of Fig. 4. It is 

p^ent invention, provided that .hey prov.de rtg.d monntang 

tothebonebeing operated o^ ^ ^^^^^ „f , 

---rr;:::r;=; r^^e. rob^e^ 

— to the 7^:;:,°ir34 IsUoned benea. the 

operatmg t^^ 50. TheX «y ^ , 
table,andat,hetopendoftheC.ann52 

fitted With an image ™^^;^-^^^^3^e, directed to a 

embedded fiduoials. The mtage, ftom Itas unag 
.mp»ti„gsystem74.ora.niring — 

o.animagehvtensifierwithadigtt.o^t -,or^^^^^^^^ 

of the computing system m ^^^^^^^ ^ them 
^aeo on^ut. An hnage processor analyzes^ ^ 
for displaying on a mcmtor 76 to the ^^^^ ^ ^ 30, 

incorporated for providhtg the correct ^^^f^^ ^4. 
to command sigoal outputs generated m the comp 
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Reference is no. made «,F.g.5B ^ ^ 

con^ut^g modules .Woh axe -^^P^*^ 7^^ ^ ^stem 7. sho^ 

schematically in Fig. 5A. output ^^^^ 
directed into an optional fluoroscopic ""^^ ^ iuelf. 
--..ruse^ensuc.a«mc..nisn^^^^^ - 

— '-''-^'^d ^rr^arset guide. . *e o. ^ 
analyzes one or more miages contammB j^e localization is 

preferredem.odiment.thedrimnggmde,su^.^*^-S ^ 

toown, and to .he target """^^'t,^, , aistal leaking nail hole, 

^.^containingthet^getiue^^— 

to determine «.e localization of the distal lockmg ^ ^ 

,3.75.aresho^inHg. ^'^'^''^^l^y, the digital imaging 

ean process the signal — ^r^. module 77.. hlch in this 
i^ationispassedtoatargetguid^jU^^^^^^^^^ ^ 

preferred embodiment generates a rigid ^ ^^^^ 
• LgethigdriUguideholesandthedis^-^^^^^^^ 

,1^ preferred computing modules 73 75 an ^ ^ 

there are shown hnplementation ^*^^\° „^^derstood that alternative 
e.hcdh„entofthepres«.inventio.«ho«^;-;^^^^^„^ ^ 

individual steps which A fiiU description of the 

^.stitutedforanyof.heproposefimc.1^-"^^*^ ^^^^^ ^ 

actional performance of each ^ ^^g^^d to be robust, accurate, 

computing system 74 and its separate modules IS 
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^.even^tlifiducial occlusions int.ein.ages, as describe 
and to function correctly even wim 

morefoUyliereinbelow. tern operational 

procedure to perform .t. .s as foUows. One ^^^^ 5, ^ 

Lu 14 has been inserted to its des^ ^^^^^^^^ ^ Rg. 5^ 

counted on the fluoroscopic Carm -''^^ " distal locking naU holes, the 
U..,adistal,ater.fl— -^^^ 
^.geon determines the location of^e^^J^^^ 
,«,bemonnted. Their axes shouldherou^yp^ ^^^^^^^^^^^^ 
3„.preferably40toS0nm.pro^toJe«.^^^^P_^^^^^^^ 

appro:dmately 30n»n '^'^"'J .. ^he self-tapping screws are 

lUp«-*'^^'^^'''"'^T;tr^rThe position of the targeting 
^ fi^ed, and the rohot base — -^J^e disL locidng nail holes, is 

g^de mounted on the ^^^^^Z positions so «>at the driU guide holes 
„„ghly adjusted between its predefined^-J^^^^^ ^^^^^^^^ 

.eapproxhnatelvabovethed^--^^^ 

is then preferably adjusted by theXray^^^^ ^^^^^^^^^^^ 

ai^tal locking nailholes are im^ed as optnndly ^ ^ ^ 

ellipses. This indicates that the « J, ^. ^ ^ to 

.eking hole axes, in what is ^^^J^^ „,,e cioseness of the 
inorease the precision of «.e proced^. *^ 

„^ hole images to a circular shape ts p.^er* y P^^^ ^ ^ 

processing software, rather ^^^^^^ relative position of *e 
technicUut. Ihe computh^g '^^^'^ hole axes, and compuU=s 

^,^gdriilguidewithr.pe.to^ed^J 
tetransformationrequiredsothatthetarge 

1^ „ail hole axes coincide^ ^ ^^^^^^^^ transformation, 

T^e —r moves the robot ^^^^^ „^ 

locics the robot with the U^getmg toU ^ ^ ^ole. and 

.oles-Thesurgeont^n..^.-- 
verifies with a new pair of X-ray uuo 
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, ..^ The surgeon proceeds to driU the 
..e. notes, ^.oves .e ... - - ^ 

,oc«ng screws into «.e newly ^^o^^ ^^^^^ ^ , bc«e. 
disul locking nail holes and fin^oc-^ ^^^^ 

^dtocompletes the surgery ^.e accurate regisBadon 

XHe preferred proceaureaescrrhea^ove^^^^^^^^^ 

ofa.etarge.ingd.U^deaxesw,«rthe..s^lo^. 

i^ge processing of the X-ray ^een the targeting 

,,^o„algorlthn.toae^e.e.n^^^^^^ 

driU guiae and the lodang naJ holes. -Hre P ^^^^^ 

^.crical fidudal m^s. as their centers ^ r^b^ ^^^^^ ^^^^^^ 

.eU..=nown in.age processing ^^^^ J^l^tlUregistration «u.ot he 
.^traaonerrorestinrateandnot^^^-S-^ ^^^^^^^ 

performed because of poor image quahty or 

fiducial occlusions. . „hich is a schematic representation of a 

..fcrenceisnowmadetoFrg.^v^h.hr^ estimated 
^ical X-ray fluoroscoprc m>age, ^'" ; 4^fl.e robot base 34, and the 

,^«onof thetargeth^arill guid. -^^^^^^ ,e set 60 within the 
^.eting drill guide 36. s^ ^^-^^^ , .w 

targeting drill guiae, ana f ^ „a,er fiaucials or other objects, 

'^^^Itrerllcy of the lateral aUgnment of the 
gencraUy always occur. T^eaes„ ^^^^^^^„,,,e 
« ^ae hole axes 4 . perpendicular to the ^lae hole 

,,es.and1hearillmgaxrs angular ae ^^^j^^ 
«.enallhole»es.Thesetoler.c.-^- ^^^^^^^^ 
e^hcreaauyinsertedwithoutm^^^ ac<^S to a f^er pre^ 
^ order to -'"-^^^^^^J^, W meOrod generaUy conslstmg 
embodiment of the present mvenhon, 

of four main steps is used: ^T,^on; 
(a)X-rayfluoroscopioimagedistorUoncorrec 
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(b) targeting drill guide localization; 

(c) distal locking nail hole axes localization; and 

(d) registration. model-based me&od is 

I, to be understood that even preferred 

.escribed belo. . appUed to the '>^'^^2tZ^y -P^^^'^ »° 
embodiments of ti.e present invention, the J' ^ , 

^.gU^g system appUcatior, whedaer ^ . sin>il. 

p^efinedfeatareinannnageofatargetgm ^ .jem is utilized for 

Lystem is When the predetined features areho^^at,^^^^ 

«.e lining up ofatarget guide hole u,=.jn.ag..^a^ ^ ^^^^ 

i^ended target itself A compvrting system for perfomung 

procedure is described inFig.5B hereinabove. 

A brief description of each step foUows. 

^^^""":rr:~c:"^°aigorit^ . .^-^^^ - 

A robust automatic <^-arm ^ i;wion The algorithm 

has been described in the artiele by H. ^J^^ h", in tiie 

C-arm— nfor— ---^^^^ 

proceedings of the 5tit ,002. To,=yo, Japan, 

------t — ^ lovel algorithm compn.es the 

B^vier Seien^---- ^ . X-ray 

distortion correction ana cam 

fluoroscopic image in three steps: calibration ring 

,,^e.gorithm^io^;----:X^^ 
fiducials and pairs them with their Know p 
«.e distortion oorrectionparametersarenext<»mp»ted^»^ 
(ai)finanytiiecaUbrationparame.ersthem^lvesarecomputed. 
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. ^ rf^efiducials and their pattern is an important 
Accurau, and robust local^^on of «.e fi<ta ^ ^^^^ 

s^oe an P-^-^^^^lX accural for 1.e oo.b.ed 

detected. 

(b)TargetingdringuidelocaUz*on. , ^..^o representadon of 

Reference is now made to Frg. 7 ^ 
mother X-ray fuorosoopio image ^^^^^ ^^^^ 

..perimposed fiducial pattern ^^ed. 
.Hchthe—onoftheta^^^^; ,aueiMs 
Targeting driU g«ide loc^-^ ^ ,„,<.aime„t of the 

eo and the pattern 64 which ^^J'^^^ ^ metai haUs of 

resent invention, the targeting dnll form of an "A", disposed on two 

Lrdi=.eter.asymmetrica.^^-^--J^^°:,^ 

^ .to in the bottom snrfece. ^^^ J ^ of parallel lines 64. 
f^^.eregis.r^^onprocedureco^.^^-0 J 

Since the fiducials are spheres, they ^PP- ^ However. 

T.. White dots insidethesph^esshow^el ^^ ^^^^^ ^^^^ 

,„„e of the spheres might be occlu^» ^^^^ 
fiaucials62andthenaill4are^P-»t- ^ ^^^^^^ , 

algorithm of the pr^t inventron. th^ ^ „^ 

alermine the h^atlon of - ^J^, ^sltlon of the driU 
abov^mentioned requirements for the dete 

, according to this preferred embodhnent of the 

The localization algorithm, accoro g 
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1 (HCa value, also known as te Pearson 
,<„elati„ncoeffiaent.ofthecuclete.p^JtP ^^^^ ^ ^ 
.alues, is compu^ to dCeroune the ."^'^ ^ofil^ebook-TOgital 

locations for the fiducials. l^^^l ii^axiina 

of the NCC, usmg one of the methoo Noordmans H.J. et al., 

detection =»d cha«oteri.ation technt<^e ^«t^^ 

i„«>eartlolen>e.e<^on=»doharac.enza.^-of^^ Vol. 70(1). 199S. Hus 
p^Ushed in compute. Vision and^Un---^^^^^^ 
p^cedureenablesdetecdonofmostomefi*^^ 

— • °rCt: r"^ed"L the ad.!, loc..^ 

:r:,t^-:^c:ponent^..^^^^ 

calciilation routine. 

(») --^'-^■^•''"Cs'tl. a schematic .ep^sentatlon of 
Reference Know made to tig . ., ^ distal locldi« holes 

.other X-ray fluoroscopic Image, showmg ^e^n^ ^ ^^^^ 

with superimposed nail longlt^al^n^^.^^^^^^ 
.ethodby whlchthelocalizatlonofthedistalloc^ ^^^^^^ 

taage is preferably determmed by first loca g ^.^ ^ 

^ ..d then locating the holes .om thetr e^jos^^ ^ ^ 

.^ontour. TO locate the naU '-^^^^^^.^or with sub-pixel edge 
embodimentofthepresentlnventron.«.eCa^y jse^^^ ^ 

localization, such as that descr*ed by . ^inWA Research 

suppressionme«.odforedgedetectlonwtth»Vpn«Ucc ^^^^ 

Keport m 2724. Sophla-Mtipolis. Fr^ce. Ko. 1995^^.^ ^^^^ 
3.D Hough transform is then preferably appUed to the m»g 
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.Mohareonp^eU-™*^ ^^^^^^^^^^^ 

fcem are lower than the gray le f„, defining the naU contours, and 

«^ this scheme is only one possible .ethod^a.^ 3^ ^, e<^y he 

^ other edge detection algorithn.. as la.o«n m th art. 

einployedforidentieringthenaUcontonrs^ 

Hav^ .nnd the nail. U^t^^-;^^ 

for .oles in the a^ ^^^^ , 

presenting the contour m a ^ equal to the nail 

P-lelepip^ "^rilte^^Laetern.^---*''-" 
^d.h.alongtena.rsmed.ala»s.Th g correspond to the 

^«^g.en.«i.alnu.her^e^el^-^^^ 

locations of the distal loctog nml holes. An P ^ ^ 

elements at these locations, such ^ hy me^s "^^^^^^^^ ^.uar. 
^.ehyK.Haiirand.Busser.errtitl^— 

«-°^*^'"CrSSrdV— onCWSCO... 
Central Europe on Computer urap 

1998. 

(d)Registration the X-ray 

The distal locking nail holes are modded ^ 
fluoroscopic can^ as a pinhole camera. Accc^d^g ^ 
are n>a^ to circles in ^e '^^"^'^^^ .onto-paraUel imaging 
perpendicular to the pl^e of ^ ^^-J-^l ^^^^ procedure of 
senap. The use of the ftonto-paraUel semp. e^^es ^ 

preferred method of the present J^.^,, j^^es the nail 

2^ensional images. TO achieve thrssewp. .hex- y^^^^^^ ^^^^ ^^^^^^ 
i^severalorientationsuntilthedistailoclangn^^^^^^^^^^^^^^^^ 

.oircles.Themeasurcofholecir<^»ty«^^^-^^^^ 
flttothedatapointsoftheedgee— of^ehM^ ^^^^^^^ 
ab„ve.Oncearatioclosetounityisachreved.theclosen 
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by a predetermined condition dependent on the accuracy practically required, the 
targeting drill guide is introduced into the imaging field of view, and an additional 
image is acquired. The rigid transformation between the drill guide hole axes and 
the distal locking nail hole axes is computed by the following method. Since the 
targeting drill guide is pre-calibrated, in that the drill guide dimensions are known, 
and the mounting position of the slide head of the drill guide relative to the robot 
top is known, the transformation firom the robot coordinate system to the targeting 
drill guide is also known. The transformation between the targeting drill guide and 
the fluoroscopic C-arm camera is determined firom the extrinsic camera 
parameters and the known geometry of the targeting drill guide. In order to bring 
the drill guide hole axes and the distal locking nail hole axes into coincidence, the 
robot is first orientated so that the drill guide hole axes are aligned with the 
camera axis, as described above, and is then translated laterally according to the 
above-described computation, until the centers of the targeting drill guide hole 
axes and the distal locking nail hole axes coincide. The robot is such as to provide 
sufficient degrees of fireedom of movement to allow alignment both in the lateral 
plane, as well as the required angular aligmnent. 

Though the system of the present invention, and the use thereof has been 
described hereinabove by means of its preferred application to the drilling of pilot 
holes for distal locking screws in long bone intramedullary nailing surgery, it is to 
be understood that this is only one example of the uses of the system of the 
present invention. The robot-guided system can be used to assist orthopaedic 
surgeons in performing other orthopaedic surgical procedures involving pre- 
positioned bone inserts which have pre-drilled holes for attachment to the bone 
undergoing the procedure, and the holes are invisible to the surgeon's eye. 

As an example of another preferred application of the system of the present 
invention, reference is now made to Fig. 9, which is a schematic cross sectional 
view of a connector plate 80 as used in the connection of a fractured neck of the 
femur to the bone shaft 88. The connector plate 80 generally has three predrilled 
holes 82 perpendicular to the shaft, for connection of the plate to the bone shaft 
88, and two predrilled holes 84, at an oblique angle, generally of 140** to the plate. 
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as is describedinaS. patent ^65.06^to ,^ 
Conneotioa is sUd into place along the shaft 

j^^usly. through a "^/"''"V ^ rear end office connector 
„e»s of a two am.ed h^dle dev.ce ^^^^J^ «.We 
pLe. The .ont end of the conne^or ^te^ c^ ^ 

insertion. Guide tubes are "-^^^f^^^.^, « into Ihe 
e^aing to the predriUed ^l^'^^'''^'^^. However, this procedure 
parts is performed using these ^^"^^^ o.the connecU« plate 
X-rav fluoroscopic images, ana u«> 
involves numerous A-ray r 
ri^ehsndledeviceisnotalwa.^^^^^^^^ 

using the robot ^ided system of the pre ^^^^^^ ^^.^^^ 

.oun.edon,hefe«>urbyme^onts»„un^--^ ^^^^^ 

^„rm the h^ertion of the connector pla^ - ^ ^ 

Lewholes— tdreuseofthepr^or^^^^^^^^^^^^,,, 

of X-ray fluoroscopic "-^-J J ^ ^„^ay positioned opposite 
p«e U inserted with its obli.ue^ ^gn^i ^ ^ 

^aeholes 94 opposite the correspon^h^^^^ ^^^^ 

«,uir^ accuracy, by means of ^ ^.e drilling guide 

^ocedures of .he present inventro. » d^^b ^ ^^^^ ^^^^ 
pl^ n is. however, different ftom " ^^ected at an «^e of 

Udure. in that it preferably l^as^d^^J^^^^^ ^^^^^^^^^^^ 

,40« to the part parallel to the femur ^ 33 ^ moved 

.^.^an^partoftheconnect^gplate^Th _^ 

^^.^..theangledpartofthed^gj-^e.^-^^^^^^ 
approxhnately opposite the -S-^"'- ^ «.e appropriate 

is repeated with the Carm '"^^^^ ^^h that they too can he 

fluoroscopic images down the used straight 

accurately driUed. Alternatively ^^ ^^^^/^ ^ «.e predetermined angle 
^ gdde plate can be and the rob 
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such that the drilling plate is approximately parallel to the angled part of the 
connector plate. 

It is to be understood by one of skill in the art that the robotic system of the 
present invention, and the associated methods of use thereof, are not limited to the 
two preferred applications described hereinabove, but can be used for similar 
procedures, where the drilling of holes is required into existing pre-drilled holes in 
orthopaedic inserts inaccessible to the surgeon's eye. Furthermore, the computing 
system and associated algorithms described hereinabove are understood to be 
generally applicable to any imaging system application, where a predefined 
feature of an image of a targeting guide must be brought to coincide with a similar 
predefined feature in an image of the intended target itself. 

It is appreciated by persons skilled in the art that the present invention is 
not limited by what has been particularly shown and described hereinabove. 
Rather the scope of the present invention includes both combinations and 
subcombinations of various features described hereinabove as well as variations 
and modifications thereto which would occur to a person of skill in the art upon 
reading the above description and which are not in the prior art. 



